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■  Additional  documents,  papers,  etc,  please  consult 

Randomized  Algorithms  for  Systems 

http://staff.polito.it/roberto.tempo/ 

and  Control:  Theory  and  Applieations 

■  Questions  may  be  sent  to 

Roberto  Tempo 

roberto.tempo@polito.it 

lEIIT-CNR 

Politecnico  di  Torino 

roberto .  tempo  @  poli  to.  it 
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■  Preliminaries 

■  Randomized  Algorithms  for  Analysis 

■  Probabilistic  Robust  Synthesis 

■  Randomized  Algorithms  for  Optimal  Control  (LQR) 

■  Extensions 

■  Applications:  Probabilistic  Control  of  Mini  UAVs 
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Preliminaries 
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Randomized  Algorithms  (RAs) 


^1  II  I  □□□□□□□DD 

■  Randomized  algorithms  are  frequently  used  in  many 
areas  of  engineering,  computer  science,  physics, 
finance,  optimization,... but  their  appearance  in  systems 
and  control  is  mostly  limited  to  Monte  Carlo 
simulations... 


■  Main  objective  of  this  mini-course:  Introduction  to 
rigorous  study  of  RAs  for  uncertain  systems  and 
control,  with  specific  applications 
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Randomized  Algorithms  (RAs) 


II  ^1  II  II  ^1  ^mnnnnfi 
■  Combinatorial  optimization,  computational  geometry 


■  Examples:  Data  structuring,  search  trees,  graph 
algorithms,  sorting  (RQS),  . . . 


■  Motion  and  path  planning  problems 

■  Mathematics  of  finance:  Computation  of  path  integrals 


■  Bioinformatics  (string  matching  problems) 


NATO  Lecture  Se 


;  sen  95 


@RT  2008 


Uncertainty 


Uncertainty  has  been  always  a  critical  issue  in  control 
theory  and  applications 

First  methods  to  deal  with  uncertainty  were  based  on  a 
stochastic  approach 

Optimal  control:  LQG  and  Kalman  filter 

Since  early  80’s  alternative  deterministic  approach 
(worst-case  or  robust)  has  been  proposed 


NATO  Lee 


Series  SCI- 195 


lEIIT-CNR 


Robustness 


II  ^1  II  II  ^1  ^mnnnnfi 

■  Major  stepping  stone  in  1981:  Formulation  of  the 
problem  by  George  Zames 


■  Various  “robust”  methods  to  handle  uncertainty  now 
exist:  Structured  singular  values,  Kharitonov, 

optimization-based  (LMI),  /-one  optimal  control, 
quantitative  feedback  theory  (QFT) 


NATO  Lecture  Se 


;  sen  95 


@RT  2008 


lEirr-CNR 


Robustness 


^1  II  I  □□□□□□□DD 

■  Late  80’s  and  early  90’s:  Robust  control  theory  became 
a  well-assessed  area 


■  Successful  industrial  applications  in  aerospace, 
chemical,  electrical,  mechanical  engineering,  . . . 

■  However,  ... 
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Limitations  of  Robust  Control  -  1 


II  ^1  II  II  ^1  ^mnnnnfi 
■  Researchers  realized  some  drawbacks  of  robust  control 


■  Consider  uncertainty  A  bounded  in  a  set  S  of  radius  p. 
Largest  value  of  p  such  that  the  system  is  stable  for  all 
A  e  S  is  called  (worst-case)  robustness  margin 

■  Conservatism:  Worst  case  robustness  margin  may  be 
small 

■  Discontinuity:  Worst  case  robustness  margin  may  be 
discontinuous  wrt  problem  data 

NATOLeclureSeriesSC!-195  @RT  2008  11 


ie™r  Limitations  of  Robust  Control  -  2 

I  ^1  II  I  □□□□□□□DD 

■  Computational  Complexity:  Worst  case  robustness  is 
often  A/!P-hard  (not  solvable  in  polynomial  time  unless 

■  Various  robustness  problems  are  A/P-hard 

-  static  output  feedback 

-  structured  singular  value 

-  stability  of  interval  matrices 

[1]  V.  Blondd  and  J.N.  Tsitsiklis  (2000) 

NATO  Lecture  Series  SCI- 195  @RT2008  1  2 
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Conservatism  and  Complexity 
Trade-Off 


II  ^1  II  II  ^1  ni 

■  Uncertain  or  control  design  parameters  often  enter  into 
the  system  in  a  nonlinear/nonconvex  fashion 


■  To  avoid  complexity  issues  (or  just  to  find  a  solution  of 
the  problem)  relaxation  techniques  such  as  SOS  are  used 


■  Study  issues  about  the  accuracy  of  the  approximation 
introduced  and  related  complexity 
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Different  Paradigm  Proposed 


^1  II  I  □□□□□□□DD 

■  New  paradigm  proposed  is  based  on  uncertainty 
randomization  and  leads  to  randomized  algorithms  for 
analysis  and  synthesis 


■  Within  this  setting  a  different  notion  of  problem 
tractability  is  needed 

■  Objective:  Breaking  the  curse  of  dimensionalityl'l 


[1]R.  Bdlman(1957) 
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Probability  and  Robustness 


II  ^1  II  II  ^1  ^mnnnnfi 
■  The  interplay  of  Probability  and  Robustness  for  control 
of  uncertain  systems 


■  Robustness:  Deterministic  uncertainty  bounded 


■  Probability:  Random  uncertainty  (pdf  is  known) 


■  Computation  of  the  probability  of  performance 

■  Controller  which  stabilizes  most  uncertain  systems 
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(^1 

,E,™  Key  Features 

^1  II  I  □□□□□□□Dl 

■  We  obtain  larger  robustness  margins  at  the  expense  of  a 
small  risk 

■  We  study  the  probability  degradation  beyond  the 
robustness  margins 

■  Computational  complexity  is  generally  not  an  issue: 
Randomized  algorithms  are  low  complexity 
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Uncertain  Systems 

— 1 1 - 1 1 - 1  1 - 1  1 - 1 1 - 1 1 — 1 1 — 1 1 — 1  n  n  [1 

_ 1 1 _ 1 1 _ 1  1 _ 1  1 _ 1 1 _ 1 1 _ 1 1 _ 1 1 _ 1  U  U 1) 

M(s)  System 

A  Uncertainty 

■ 

A  belongs  to  a  structured  set  So 

-  Parametric  uncertainty  q 

-  Nonparametric  uncertainty  A, 

-  Mixed  uncertainty 

NATO  Le 
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Worst  Case  Model 

^1  II  I  □□□□□□□Dl 

■  Worst  case  model:  Set  membership  uncertainty 

■  The  uncertainty  A  is  bounded  in  a  set  So 

AeSo 

■  Real  parametric  uncertainty  qj  e  R*” 

■  Nonparametric  uncertainty 

A,  e  {A,.e  R"’":  II  A, II  <  1) 


3 


4 
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Uniform  Density 


II  ^1  II  II  ^1  ^mnnnnfi 
■  Take/^(A)=‘l/[S£,]  (uniform  density  within  S^) 


'U[%]= 


1 


vo/(Sf,  ) 

0 


t/Ae  4 
otherwise 


■  In  this  case,  for  a  subset  Sc^  So 


Pr{As  S}  = 


vol{Sc ) 


vol{S) 
voliSi, ) 
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Performance  Function 

^1  II  I  □□□□□□□DD 

■  In  classical  robustness  we  guarantee  that  a  certain 
performance  requirement  is  attained  for  all  Ag 

■  This  can  be  stated  in  terms  of  a  performance  function 

J  =  7(A) 

■  Examples:  performance  and  robust  stability 
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Example:  Performance  -  1 

II  ^1  II  II  ^1  ^mnnnnfi 
Compute  the  norm  of  the  upper  LET  7^(M,A) 

7(A)  =  II  j^(M,  A)IL 
For  given  y>0,  check  if 

7(A)  <  Y 

for  all  A  in  Sn 
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Example:  9^^  Performance  -  2 


^1  II  I  □□□□□□□DD 

■  Continuous  time  SISO  systems  with  real  parametric 
uncertainty  q  with  upper  LET 


=  tr^iM,q)  = 


(!()“’  +  0.05  q^)s^  +  (0.00102  +  0.5q^)s+  (2-10“’  +  0.5?() 
where  q^  G  [0.2,  0.6]  and  s  [10"^,3T0"^] 

■  Letting  J(q)  =  II  !f^{M,q)  W^,  we  choose  y=0.003 

■  Check  if  Jiq)<y  for  all  q  in  these  intervals 
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Example:  Performance  -  3 

1 

^nnnn 

■  The  set  of  q^,  for  which  J(q)<yis  shown  below 

li: 

- 

^1 

NATO  Lecture  Series  SCH 95 
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lE^i  Example^^^:  Robust  Stability  -  1 

I  ^1  II  I  □□□□□□□DD 

■  Consider  the  closed  loop  uncertain  polynomial 

p{s,q)  = 

(l  -I-  -I-  6r?,  +  6r?2  +  29,^2 )+  (ft  +  ?2  +  +  (ft  +  ft  + 1)-*^  + 

where  q^  G  [0.3,  2.5],  ^2  s  [0,1.7]  and  r=0.5 

■  Check  stability  for  all  q  in  these  intervals 

[1]G.  Tmxal(l%l) 

NATO  Lecture  Series  SCn95  @RT2008  30 
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ieiTT^r  Example:  Closed-Form  Computation 

PI:  Performanee  Verifieation 

1  II  ^1  1 1  II  ^1  ^1  nn 

1  ^1  II  1 1  1 1  II  irni^nnno 

■  For  Truxal’s  example,  we  compute  in  closed-form 

■  For  uniform  distribution,  we  have 

vo/(4„J  =  3.74-7rr2 

voKSjj)  =  3.74 

■  For  given  performance  level  y,  check  whether 

7(A)  <  Y 

for  all  A  in  Sq 

■  Compute  the  probability  of  performance 

NATO  Lecture  Series  SCH95  @RT  2008  37 
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P2:  Worst-Case  Performanee 

ti] 
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1  II  ^1  1 1  II  ^1  ^1  ^nnn  nn 

1  ^1  II  1 1  1 1  II  irnnnnnp 

■  Find  such  that 

7max  =maxy(A) 

AeB„ 

■  Compute  the  worst  case  performance  (or  its 
probabilistic  counterpart) 

Randomized  Algorithms 
for  Analysis 

NATO  Lecture  Series  SCH95  @RT  2008  39 
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Randomized  Algorithm:  Definition 

(Pl 

Randomized  Algorithm:  Definition 

1  II  ^1  1 1  II  ^1  ^1  ^nnn  nn 

1  ^1  II  1 1  1 1  II  irni^nnno 

■  Randomized  Algorithm  (RA):  An  algorithm  that  makes 
random  choices  during  its  execution  to  produce  a  result 

■  Example  of  a  “random  choice”  is  a  coin  toss 

heads  or  tails 

Q 

■  Randomized  Algorithm  (RA):  An  algorithm  that  makes 
random  choices  during  its  execution  to  produce  a  result 

■  For  hybrid  systems,  “random  choices”  could  be 
switching  between  different  states  or  logical  operations 

■  For  uncertain  systems,  “random  choices”  require  (vector 
or  matrix)  random  sample  generation 

NATO  Lecture  Series  SCH95  @RT  2008  41 
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Las  Vegas  Randomized  Algorithms 


II  ^1  II  II  ^1  ^mnnnnfi 
■  We  also  have  zero-sided  (Las  Vegas)  randomized 
algorithms 


■  Las  Vegas  Randomized  Algorithm  (LVRA):  Always 
give  the  correct  solution 


■  The  solution  obtained  with  a  LVRA  is  probabilistic,  so 
“always”  means  with  probability  one 

■  Running  time  may  be  different  from  one  run  to  another 


■  We  can  study  the  average  running  time 
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Discrete  Bounding  Set 

ni  II  I  □□□□□□□DD 


Consider  random  uncertainty  A,  a  discrete  bounding  set 
B,  given  pdf  and  performance  function 


A'  A’  A*  A^  A“  A’  A®  A’  A‘“ 

NATO  Lecture  Series  SCI- 195  @RT2008  58 
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The  Las  Vegas  Viewpoint 


II  ^1  II  II  ^1  ^mnnnnfi 

■  Consider  discrete  random  variables 

■  The  sample  space  is  discrete  and  M'''  possible  choices 
can  be  made 

■  In  the  binary  case  we  have  2'^ 

■  Finding  maximum  requires  ordering  the  2^  choices 

■  Las  Vegas  can  be  used  for  ordering  real  numbers 


■  Example:  Randomized  Quick  Sort  for  sorting  real 
numbers  (classical  in  computer  science) 
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,  — Ingredients  for  RAs 

^1  II  I  □□□□□□□DD 

■  Assume  that  A  is  random  with  pdf/^(A)  with  support  ®o 

■  Accuracy  e  s  (0, 1)  and  confidence  tfs  (0, 1)  be  assigned 

■  Performance  function  for  analysis  and  level 

i  i 

J  =  J(A)  y 
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Chernoff  Bound 

11  II  II  ^1  ^mnnnnfi 


■  Remark:  Chernoff  bound  improves  upon  other  bounds 
such  as  Bernoulli  (Law  of  Large  Numbers) 

■  Dependence  on  l/(Jis  logarithmic 

■  Dependence  on  1/fis  quadratic 


€ 

0.1% 

0.1% 

0.5% 

0.5% 

1-8 

99.9% 

99.5% 

99.9% 

99.5% 

N 

3.910« 

3.0I0'5 

i.eioo 

1.21(T 
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: — I  Computational  Complexity  of  RAs 

lEirr-CNR  ^  ^ 

^1  II  I  □□□□□□□Dl 

■  RAs  are  efficient  (polynomial-time)  because 

1.  Random  sample  generation  of  A'  can  be  performed  in 
polynomial-time 

2.  Cost  associated  with  the  evaluation  of  7(A‘)  for  fixed 
A'  is  polynomial-time 

3.  Sample  size  is  polynomial  in  the  problem  size  and 
probabilistic  levels  e  and  5 
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1.  Random  Sample  Generation 

II  ^1  II  II  ^1  ^nnnn  ni 

■  Random  number  generation  (RNG):  Linear  and 
nonlinear  methods  for  uniform  generation  in  [0,1)  such 
as  Fibonacci,  feedback  shift  register,  BBS,  MT,  ... 

■  Non-uniform  univariate  random  variables:  Suitable 
functional  transformations  (e.g.,  the  inversion  method) 

■  The  problem  is  much  harder:  Multivariate  generation  of 
samples  of  A  with  pdf/^(A)  and  support 

■  It  can  be  resolved  in  polynomial-time 
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i — J  2.  Cost  of  Checking  Stability 

lEirr-CNR 

^1  II  I  □□□□□□□Dl 

■  Consider  a  polynomial 

p(s,a)  =  ag  +  aiS-\ - 

■  To  check  left  half  plane  stability  we  can  use  the  Routh 
test.  The  number  of  multiplications  needed  is 

—  for  n  even  - - for  n  odd 

4  4 

■  The  number  of  divisions  and  additions  is  equal  to  this 
number 

■  We  conclude  that  checking  stability  is  O(n^) 


i-J  3.  Bounds  on  the  Sample  Size 

lEIIT-CNR  ^ 

II  ^1  II  II  ^1  ^mnnnnfi 

■  Chernoff  bound  is  independent  on  the  size  of  So,  on 
the  structure  D  on  the  number  of  blocks,  on  the  pdf 
/a(A) 

■  It  depends  only  on  5  and  e 

■  Same  comments  can  be  made  for  other  bounds  such  as 
Bernoulli 
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■  Recall  that 


Worst-Case  Performance 

ni  II  I  □□□□□□□Dl 

-/max  =  max /(A) 

AeSo 


■  Generate  A^i.i.d.  samples 

A',  A2,  ...,  A^  e  So 
according  to  the  density/^ 

■  Compute  the  empirical  maximum 

-/max  =  max  y(A‘) 
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Comparison  and  Comments 

^1  II  I  □□□□□□□Dl 

■  Number  of  samples  is  much  smaller  than  Chernoff 

■  Bound  is  a  specific  instance  of  the  fpras  (fully 
polynomial  randomized  approximated  scheme)  theory 

■  Dependence  on  1/eis  basically  linear  = 


€ 

0.1% 

0.1% 

0.5% 

0.5% 

0.01% 

0.001% 

l-S 

99.9% 

99.5% 

99.9% 

99.5% 

99.99% 

99.999% 

N 

6.91103 

5.30103 

1.38103 

1.06- 103 

9.2M0'' 

1.1610'3 
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J — J  Confidence  Intervals 

iirr-CNR 

ni  II  I  □□□□□□□Di 

The  Chernoff  and  worst-case  bounds  can  be  computed  a- 
priori  and  provide  an  explicit  functional  relation 
N  =  N(  e,  S) 

The  sample  size  obtained  with  the  confidence  intervals  is 
not  explicit 

Given  rfetO,!),  upper  and  lower  confidence  intervals 
and  are  such  that 

Pr{p,<p<p,\=l-S 
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Statistical  Learning  Theory 

VC  and  P-dimensiont*’^] 

1  II  ^1  1 1  II  ^1  ^1  nn 

1  ^1  II  1 1  II  II  irni^nnno 

■  The  Chernoff  Bound  studies  the  problem 

Pv{\p^-p„\<e\>l-S 
where  =  Pr{y(A)  <  y  } 

■  Performance  function  J  is  fixed 

■  Statistical  Learning  Theory  computes  bounds  on  the 
sample  size  for  the  problem 

Pr{|Pr(y(A)  <  y)- p^l  <  e,Vy  s  jr}>  1  -  ^ 
where  J”  is  a  given  class  of  functions 

■  Statistical  Learning  Theory  aims  at  studying  uniform 
Law  of  Large  Numbers 

■  The  bounds  obtained  depend  on  quantities  called  VC- 
dimension  (if  7  is  a  binary  valued  function),  or  P- 
dimension  (if  7  is  a  continuous  valued  function) 

■  VC  and  P-dimension  are  measures  of  the  problem 
complexity 

[1]M.  Vidyasagar(1997) 

[21E.D.  Sontag(1998) 

NATO  Lecture  Series  SCl-195  @RT2008  79 

NATO  Lecture  Series  SCI- 195  @RT2008  80 

ei 


Choice  of  the  Distribution  -  1 

II  ^1  II  II  ^1  ^mnnnnfi 


■  The  probability  Pr|  A  s  S] 
depends  on/^(A) 

■  It  may  vary  between  0 
and  1  depending  on  the 
Pdf/^CA) 
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Choice  of  the  Distribution  -  2 

II  II  I  □□□□□□□  DD 


■  The  bounds  discussed  are  independent  on  the  choice 
of  the  distribution  but  for  computing  Pr{y(A)  <  y  }  we 
need  to  know  the  distribution /^(A) 

■  Some  research  has  been  done  in  order  to  find  the 
worst-case  distribution  in  a  certain  classPl 

■  Uniform  distribution  is  the  worst-case  if  a  certain 
target  is  convex  and  centrally  symmetric 


[1]  B.  R.  Barmish  and  C.  M.  Lagoa  (1997) 
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Choice  of  the  Distribution  -  3 

II  ^1  II  II  ^1  ^mnnnnii 


■  Minimax  properties  of  the  uniform  distribution  have 
been  studiedPl 


[1]  E.  W.  Bai,  R.  Tempo  and  M.  Fu  (1998) 
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Analysis  vs  Design  with  Uncertainty 


DaannDDO 


Starting  point:  Worst-case  analysis  versus  design 
Consider  an  interval  family  p{s,q),  ^sS^={^sR",ll^ll^<l } 
Analysis  problem: 

-  Check  if  p(s,q)  is  stable  for  all  gs 
Answer:  Kharitonov  Theorem 

Design  Problem: 

-  Does  there  exist  a  qG  such  that  p(s,q)  is  stable? 
Answer:  Unknown  in  general 


NATO  Lecture  Series  SCH95 


Synthesis  Paradigm 


A 


K, 


■  Design  the  parameterized  controller  Kg  to  guarantee 
stability  and  performance 

NATO  Lecture  Series  SCI- 195  @RT2008  86 


Synthesis  Performance  Function 


II  ^1  II  II  ^1  ^mnnnnfi 

■  Recall  that  the  parameterized  controller  is  Kg 

■  We  replace  7(A)  with  a  synthesis  performance  function 


7  =  7(A,0) 


where  6  s  0  represents  the  controller  parameters  to  be 
determined  and  their  bounding  set 
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!£— Jp  Randomized  Algorithms  for  Synthesis 

I  ^1  II  I  □□□□□□□DD 

■  Two  classes  of  RAs  for  probabilistic  synthesis 

■  Average  performance  synthesisl'l 

■  Based  on  expected  value  minimization 

■  Use  of  Statistical  Learning  Theory  results 

■  Very  general  problems  can  be  handled 

■  Existing  bounds  are  very  conservative  and  controller 
randomization  is  required 

■  Ongoing  research  aiming  at  major  reduction  of  sample 
size 

[IIM.  Vidyasagar(1998) 
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ieHTSItfi  Randomized  Algorithms  for  Synthesis 

II  ^1  II  II  ^1  ^nnnn  ni 

■  Robust  performance  synthesisl'l 


■  Problem  reformulation  as  robust  feasibility 

■  Only  convex  problems  can  be  handled 

■  Finite-time  convergence  with  probability  one  is  obtained 


[1]B.  Polyak  and  R.  Tempo  (2001) 


NATO  Lecture  Se 


:SCI-195 


89 


ie™r  Robust  Performance  Synthesis 

I  ^1  II  I  □□□□□□□DD 

■  Uncertainty  randomization  of  A  in  So 

■  Convex  optimization  to  design  the  controller  K(.s) 


15 


tA 
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RAs  for  Optimal  Control  (LQR) 
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lEi™  Uncertain  Systems  in  State  Space 

I  ^1  II  I  □□□□□□□Dl 

■  We  consider  a  state  space  description  of  the  uncertain 
system 

x{t)  =  A(A)x(t)  +  Bu(t) 

with  x(0)=Xo;  xe  R";  ue  R'",  As 

■  For  example,  A(A)  is  an  interval  matrix  with  bounded 
entries  a, I  <  a^j  <  at 
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Interval  and  Vertex  Matrices 

ni  ^1  II  II  ^1  ^mnnn  ni 

We  consider  interval  uncertainty  A  (i.e.  when  Ae  Sj,) 

That  is,  ranges  in  the  interval  for  all  i,  k 

la,i  -  a,i*  I  <  w,.j 

where  are  nominal  values  andw^jare  weights 
Define  the  N  =  2"^  vertex  matrices  A',A^,...,A^ 
an  =  an*  +  Wn  or  =  a^  - 


for  all  i,  k=l,  2,  ...,  n 


lEiii^NR  Common  Lyapunov  Functions 

I  ^1  II  I  □□□□□□□Dl 

■  Given  matrices  A*,  W  and  feedback  K,  find  a  common 
quadratic  Lyapunov  function  Q>Q  for  the  system 

x(t)  =  (A  +  B  K)  x(f)  for  all  As  A 

■  Find  Q>Q  such  that 

L  (2,  A)  =  (A-rfiAO^  e  +  2  U+SAT)  <  0  for  all  A  s /I 

■  Equivalently,  find  Q>0  such  that 

"Kmax  i-  (2>  A)  <  0  for  all  A  S  /I 


lE^i^R  Lyapunov  Stability  of  Interval  Systems 

I  II  ^1  II  II  ^1  ^mnnnnfi 

■  Quadratic  Lyapunov  stability  analysis  and  synthesis  of 
interval  systems  are  NP-hard  problems 

■  In  principle,  they  can  be  solved  in  one-shot  with  convex 
optimization,  but  the  number  of  constraints  is 
exponential 

■  We  can  use  relaxation  (e.g.  7t/2  Theorem^*])  or 
randomization 

[1]  Yu.  Nesterov  (1997) 
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Vertex  Solution 


^1  II  I  □□□□□□□Dl 

■  Due  to  convexity,  it  suffices  to  study  L  (Q,  A)  <  0  for 
all  vertex  matricesPl 


■  Question:  Do  we  really  need  to  check  all  the  vertex 
matrices  {N  =  2"^)? 


[1]  H.P.  Horisberger,  P.R.  Belanger  (1976) 
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Vertex  Reduetion 


II  ^1  II  II  ^1  ^nmnn  ni 

■  Answer:  It  suffices  to  check  “only”  a  subset  of  2^" 
vertex  matrices^] 


■  This  is  still  exponential  (the  problem  is  NP-hard),  but 
it  leads  to  a  major  computational  improvement  for 
medium  size  problems  (e.g.  n  =  8  or  10) 

■  For  example,  for  f!=8,  N  is  of  the  order  10^  (instead  of 
lO'") 


[1]  T.  Alamo,  R.  Tempo,  D.  Rodriguez,  E.F.  Camacho  (2007) 
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IE,— Jp  Diagonal  Matrices  and  Generalizations 

^1  II  I  □□□□□□□DD 

■  Transform  the  original  problem  from  full  square 
matrices  A  to  diagonal  matrices  Z  s  R2».2n 

■  It  suffices  to  check  the  vertices  of  Z 

■  Extensions  for  Aj-gain  minimization  and  other  related 
LMI  problems 

■  Generalizations  for  multiaffine  interval  systems 


NATO  Lecture  Series  SCI- 195  @RT2008  98 


Las  Vegas  Randomized  Algorithm 


II  ^1  II  II  ^1  ^nnnn  ni 

■  We  may  perform  randomization  of  the  N  =  2"^  vertices 
(in  the  worst  case) 


■  If  we  select  the  vertices  in  random  order  according  to  a 
given  pdf,  we  have  a  LVRA 
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lE,— Jp  Probabilistic  Solution 

I  ^1  II  ^1  ^1  II  irnnnnnp 

■  Randomly  generate  A*,...,  A^.  Then,  check  if  the 
Lyapunov  equation 

A‘Q  +  Q{A‘f  <0 

is  feasible  for  i=l,...,N  and  find  a  common  solution 
2=2^ >0 

■  Critical  problem:  Even  if  N  is  relatively  small,  this  is  a 
hard  computational  problem 


NATO  Lecture  Series  SCI- 195  @RT2008  1  00 


Sequential  Algorithm 

HI  ^1  II  II  ^1  ^nnnn  ni 

Key  point:  Sequential  algorithm  which  deals  with  one 
constraint  at  each  step 
At  step  k  we  have 

Phase  1 :  Uncertainty  randomization  of  A 
Phase  2:  Gradient  algorithm  and  projection 
Pinal  result:  Find  a  solution  Q=Q^  >0  with  probability 
one  in  a  finite  number  of  steps 


NATO  Lecture  Series  SCH95 


I  ^1  ir 

■  Let  <5j,  be  an  Euclidean  space 


Definition 


£^=i^A  =  A^  eR",\A\\= 

\  <.i=i 


and  C  be  the  cone  of  positive  semi-definite  matrices 
C  =  {Ae  <?„  :A>0} 


NATO  Lecture  Series  SCI- 195 


17 


Projection  on  a  Cone 

iE|— Phase  1 :  Uncertainty  Randomization 

1  II  ^1  1 1  II  ^1  ^1  ^mnn  nn 

1  ^1  II  1 1  1 1  II  irni^nnno 

■  For  any  real  symmetric  matrix  A  we  define  the 
projection  [Aj+sC  as 

[AI*  =  arg  min  A  -  X 

■  The  projection  can  he  computed  through  the  eigenvalue 
decomposition  A=TAT^ 

m  Then 

[AT=TfCf 

where  A,;+=max  {X,  ,0} 

■  Uncertainty  randomization:  Generate  A*  e 

■  Then,  for  guaranteed  cost  we  obtain  the  Lyapunov 
equation 

A(A‘)e  +  eAGA*)<  0 

NATO  Lecture  Series  SCH95  @RT  2008  1  03 
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Matrix  Valued  Function 

1^— Phase  2:  Gradient  Algorithm 

1  II  ^1  1 1  II  ^1  ^1  ^nnn  nn 

1  ^1  II  1 1  1 1  II  irni^nnno 

■  Define  a  matrix  valued  function 

V(QA)=A(A)Q+QA(A') 

and  a  scalar  function 

v(e,A‘)=  [T(e,A‘)f 

where  II  ■  II  is  the  Frobenius  norm 

■  We  can  also  take  the  maximum  eigenvalue  of  V(Q,A'‘) 

■  We  write 

gr..^|[e‘-/9e{v(e‘,A‘)}r  ifv(e\A‘)>0 
[  Q'‘  otherwise 

where  is  the  subgradient  and  the  stepsize  f/  is 

,  v(e‘,A‘)+r||aJv(e‘,A‘)}|| 

IK.Me‘.A‘)lir 

and  r>0  is  a  parameter 

NATO  Lecture  Series  SCH95  @RT  2008  1  05 
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ieiFsJr  Closed-form  Gradient  Computation 

lE^u  Theorem^] 

1  II  ^1  1 1  II  ^1  ^1  ^nnn  nn 

1  ^1  II  1 1  1 1  II  irni^nnno 

■  The  function  v(2,A*)  is  convex  in  Q  and  its  subgradient 
can  be  easily  computed  in  a  closed  form 

■  Assumption:  Every  open  subset  of  Sp  has  positive 

measure 

■  Theorem:  A  solution  Q,  if  it  exists,  is  found  in  a  finite 
number  of  steps  with  probability  one 

■  Idea  of  proof:  The  distance  of  2*  from  the  solution  set 
decreases  at  each  correction  step 

[1]  B.T.  Polyak  and  R.  Tempo  (2001) 

NATO  Lecture  Series  SCH95  @RT  2008  1  07 
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lEIIT-CNR 


Example^^^ 


II  ^1  II  II  ^1  ^mnnnnfi 
■  We  study  a  multivariable  example  for  the  design  of  a 
controller  for  the  lateral  motion  of  an  aircraft. 


■  The  model  consists  of  four  states  and  two  inputs 


0 

1 

0 

0 

0 

0 

0 

L, 

h 

L,, 

0 

-3.91 

g/ 

/v 

0 

-1 

x(t)  + 

0.035 

0 

Nf  +  NfYi, 

-2.53 

0.31  _ 

[1]  B.D.O.  Anderson  and  J.B.  Moore  (1971) 
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f.1 

lEirr-CNR 

Example  -  2 

^rnnnnn 

■  The  state  variables  are 

-  x^  bank  angle 

-  X2  derivative  of  bank  angle 

-  X3  sideslip  angle 

-  X4  jaw  rate 

■  The  control  inputs  are 

-  rudder  deflection 

-  U2  aileron  deflection 

NATO  Lecture  Series  SCI- 195  @RT2008 
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Example  -  3 

Dizzii^aannnDo 


■  Nominal  values:  £^=-2.93,  Lp=-4.75,  L=0JH, 

gA'=0.086,  Tp=-0.11,  A'p=0.1,  Al,=-0.042,  A'p=2.601, 
N=-0.29 


■  Perturbed  matrix  A(A):  each  parameter  can  take  values  in 
a  range  of  ±15%  of  the  nominal  value 

■  Quadratic  stability  (7=0):  take  R=I  and  5=0.01/ 

■  Remark:  A(A)  is  multiaffine  in  the  uncertain  parameters: 
quadratic  stability  can  be  ascertained  solving 
simultaneously  2^=512  LMIs 
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ni - ^1 - 

■  Sequential  algorithm: 

-  Initial  point  Qq  randomly  selected 

-  800  random  matrices  A* 

-  The  algorithm  converged  to 


Example  -  4 


0.7560 

-  0.0843 

0.1645 

0.7338' 

-0.0843 

1.0927 

0.7020 

0.4452 

0.1645 

0.7020 

0.7798 

0.7382 

0.7338 

0.4452 

0.7382 

1.2162 
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Example  -  5 

Dizzii^aannnDo 


■  The  corresponding  controller 


K  =  B^Q-' 


38.6191 

-2.8814 


-4.3731 

-10.1758 


43.1284 

10.2370 


-49.9587' 

-0.4954 


satisfies  all  the  512  vertex  LMIs  and  therefore  it  is  also  a 
quadratic  stabilizing  controller  in  a  deterministic  sense 


■  The  optimal  LQ  controller  computed  on  the  nominal 
plant  satisfies  only  240  vertex  LMIs 
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Extensions 
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Related  Literature  and  Extensions 


II  ^1  II  II  ^1  ^mnnnnfi 
■  Minimization  of  a  measure  of  violation  for  problems 
that  are  not  strictly  feasible!*! 


■  Uncertainty  in  the  control  matrix,  Ae  Sd 

We  take  the  feedback  law 


u  =  YQ  'x 

where  Y  and  Q=Q^  >0  are  design  variables 


[1]  B.R.  Bamiish  and  P.  Shcherbakov  (1999) 
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Related  Literature 


^1  II  I  □□□□□□□DD 

■  Related  literature  on  optimization  and  adaptive  control 
with  linear  constraintst^’^’^’"^] 


■  Stochastic  approximation  algorithms  have  been  widely 
studied  in  the  stochastic  control  and  optimization 
literaturet^’^] 


[1] S.  Agmon(1954) 

[2]  T.S.  Motzkin  and  I.J.  Schoenberg  (1954) 
[31B.T.  Polyak  (1964) 

[4]  V.A.  Bondarko  and  V.A.  Yakubovich  (1992) 

[6]  H  J.  Kushner  and  G.G.  Yin  (2003) 

[7]  J.C.  Spall  (2003) 
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Subsequent  Research 


II  ^1  II  II  ^1  ^mnnnnfi 

■  Design  of  common  Lyapunov  functions  for  switched 
systems!*! 

■  From  common  to  piecewise  Lyapunov  functions!^! 

■  Ellipsoidal  algorithm  instead  of  gradient  algorithm!^! 

■  Stopping  rule  which  provides  the  number  of  steps!'*! 

■  Other  algorithms  have  been  recently  proposed!^"^! 


[1]  D.  Liberzon  and  R.  Tempo  (2004) 

[2]  H.  Ishii,  T.  Basar  and  R.  Tempo  (2005) 

[3]  S.  Kanev,  B.  De  Schuller  and  M.  Verhaegen  (2002) 

[4]  Y.  Oishi  and  H.  Kimura  (2003) 

[5]  Y.  Fujisaki  and  Y.  Oishi  (2007) 

[6]  T.  Alamo,  R.  Tempo,  D.  R.  Ramirez  and  E.  F.  Camacho  (2007) 
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Optimization  Problems 


^1  II  I  □□□□□□□DD 

■  Extensions  to  optimization  problems 


■  Consider  convex  function  f(x)  and  function  g(x,A) 
convex  in  x  for  fixed  zl 


■  Semi-infinite  (nonlinear)  programming  problem 
min/(x) 


g(x,/l}  <  0  for  aWA&S 

■  Reformulation  as  stochastic  optimization 

■  Drawback:  Convergence  results  are  only  asymptotic 


[1]  V.  B.  Tadic,  S.  P.  Meyn  and  R.  Tempo  (2003) 
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Scenario  Approach 

II  ^1  II  II  ^1  ^nnnn  ni 

■  The  scenario  approach  for  convex  problems!*! 

■  Non-sequential  method  which  provides  a  one-shot 
solution  for  general  convex  problems 

■  Randomization  of  A  e  S  and  solution  of  a  single  convex 
optimization  problem 

■  Derivation  of  a  bound  on  the  sample  size!*! 

■  A  new  improved  bound  based  on  a  pack-based  strategy!^! 


[1]  G.  Calafiore  and  M.  Campi  (2004) 

[2]  T.  Alamo,  R.  Tempo  and  E.F.  Camacho  (2007) 
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IE— Jp  Convex  Semi-Infinite  Optimization 

I  ^1  II  I  □□□□□□□DD 

■  The  semi-infinite  optimization  problem  is 

minc^tl  subject  to /(0,  zl)  <  0  for  all  zl  s  S 

where /(0,  zl)  <  0  is  convex  in  6  for  all  zl  s  S 

■  We  assume  that  this  problem  is  either  unfeasible  or,  if 
feasible,  it  attains  a  unique  solution  for  all  zl  s  S  (this 
assumption  is  technical  and  may  be  removed) 

■  We  assume  that  0  e  ©  C  R" 

NATO  Lecture  Series  SCI- 195  @RT2008  1  20 
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Scenario  Problem 


II  ^1  II  II  ^1  ^mnnnnfi 

■  Using  randomization,  we  construct  a  scenario  problem 

■  Taking  random  samples  zl', !  =  1,  2,  . . we  construct 

/((9,Zl‘)<0,  i  =  l,2,  ....IV 


and 


min  c'^d  subject  to  f{0,  zl')  <  0,  i=  1,2,  ...,N 
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Theorem^^] 


^1  II  I  □□□□□□□DD 

■  Theorem:  For  any  ee  (0,1)  and  S  e  (0,1),  if 


N  >\2le  log(l/(5)  +  2n  +  2nle  log  (2/£')  ] 
then,  with  probability  no  smaller  than  I-  S 

-  either  the  scenario  problem  is  unfeasible  and  then  also 
the  semi-infinite  optimization  problem  is  unfeasible 

-  or,  the  scenario  problem  is  feasible,  then  its  optimal 
solution  df,  satisfies 

Pr{  zle  S  :/(6»,zl)>0  }<£ 

[1]  G.  Calafiore  and  M.  Campi  (2004) 
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A  New  Improved  BoundP^ 


II  ^1  II  II  ^1  ^mnnnnfi 
■  A  new  improved  bound  (based  on  a  so-called  pack- 
based  strategy)  has  been  recently  obtained 

N  >  I  2/e  log(l/2^  +  2n  +  2nle  log  4  | 


■  The  main  difference  with  the  previous  bound  is  that  the 
factor 

2nle  log  (2le) 

is  replaced  with 

2nle  log  4 


[1]  T.  Alamo,  R.  Tempo  and  E.F.  Camacho  (2007) 
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RACT 
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RACT 

tcziaannnDDi 


■  RACT:  Randomized  Algorithms  Control  Toolbox  for 
Matlab 


■  RACT  has  been  developed  at  lEIIT-CNR  and  at  the 
Institute  for  Control  Sciences-RAS,  based  on  a  bilateral 
international  project 

■  Members  of  the  project 

Andrey  Tremba  (Main  Developer  and  Maintainer) 

Giuseppe  Calafiore 
Fabrizio  Dabbene 
Elena  Gryazina 

Boris  Polyak  (Co-Principal  Investigator) 

Pavel  Shcherbakov 

Roberto  Tempo  (Co-Principal  Investigator) 
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■  Main  features 


RACT 

tnnnnni 


■  Define  a  variety  of  uncertain  objects:  scalar,  vector  and 
matrix  uncertainties,  with  different  pdfs 

■  Easy  and  fast  sampling  of  uncertain  objects  of  almost 
any  type 

■  Randomized  algorithms  for  probabilistic  performance 
verification  and  probabilistic  worst-case  performance 

■  Randomized  algorithms  for  feasibility  of  uncertain  LMIs 
using  stochastic  gradient,  ellipsoid  or  cutting  plane 
methods  (YALMIP  needed) 
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II  ^1  II  II  ^1  ^mnnnnfi 


Applications  of  Randomized 
Algorithms 
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Application  of  RAs 


^1  II  I  □□□□□□□DD 

■  Randomized  algorithms  have  been  developed  for 


various  specific  applications 


■  Control  of  flexible  structures 


■  Stability  and  robustness  of  high  speed  networks 

■  Stability  of  quantized  sampled-data  systems 

■  Brushless  DC  motors 


■  Control  design  of  Mini  UAV 
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11  ^1  II  II  ^1  ^mnnnnfi 


Probabilistic  Control  of 
Mini-UAVs[i] 


f  1]  L  Lorefice,  B.  Pralio  and  R.  Tempo  (2007) 


^  Italian  National  Project 

for  Fire  Prevention 

^1  II  ^  I  ^  I  II  irnnnnni 

■  This  activity  is  supported  by  the  Italian  Ministry  for 
Research  within  the  National  Project 

Study  and  development  of  a  real-time  land  control  and 
monitoring  system  for  fire  prevention 

■  Five  research  groups  are  involved  together  with  a 
government  agency  for  fire  surveillance  and  patrol 
located  in  Sicily 

■  The  aerial  platform  is  based  on  the  MicroHawk 
configuration,  developed  at  the  Aerospace  Engineering 
Department,  Politecnico  di  Torino,  Italy 
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MHIOOO  Platform  -  1 

I  ^1  II  II  ^1  ^nnnn  ni 


■  Platform  features 

-  wingspan  3.28  ft  (1  m) 

-  total  weight  3.3  lb  (1.5  kg) 
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MHIOOO  Platform  -  2 

II  II  I  □□□□□□□Dl 


■  Main  on-board  equipment 

-  various  sensors  and  two  cameras  (color  and  infrared) 

■  DC  motor 

■  Remote  piloting  and  autonomous  flight 

■  Flight  endurance  of  about  40  min 

■  Flight  envelope 

-  min/max  velocity:  33  ft/s  (10  m/s)  -  66  ft/s  (17  m/s) 

-  average  velocity:  43  ft/s  (14  m/s) 
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,E,™  State  Space  Model 

I  ^1  II  I  □□□□□□□Dl 

■  State  space  formulation  obtained  by  linearization  of  the 
full  (12  coupled  nonlinear  ODE)  model 

x(t)  =  A(A)  x(t)  +  -B(A)  u(t) 
u(t)  =  -  K  x(t) 

where  x  =  [V,  (X,  q,  0\^  (V  flight  speed,  a  angle  of 
attack,  q  and  0  pitch  rate  and  angle),  A  uncertainty 

■  Consider  longitudinal  plane  dynamics  stabilization 

■  Control  u  is  the  symmetrical  eleven  deflection 
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Uncertainty  Description  -  1 

Uncertainty  Description  -  2 

1  II  ^1  1 1  II  ^1  ^1  nn 

1  ^1  II  1 1  1 1  II  irni^nnno 

■  We  consider  structured  parameter  uncertainties  affecting 
plant  and  flight  conditions,  and  aerodynamic  database 

■  Uncertainty  vector  A  =  [(5|,...,  (5|J  where  [d[,  5*} 

■  Key  point:  There  is  no  explicit  relation  between  state 
space  matrices  A  and  B  and  uncertainty  A 

■  This  is  due  to  the  fact  that  state  space  system  is  obtained 
through  linearization  and  off-line  flight  simulator 

■  The  only  techniques  which  could  be  used  in  this  case  are 
simulation-based  which  lead  to  randomized  algorithms 

■  We  consider  random  uncertainty  A  =  [(5j,..., 

■  The  pdf  is  either  uniform  (for  plant  and  flight 
conditions)  or  Gaussian  (for  aerodynamic  database 
uncertainties) 

■  Flight  conditions  uncertainties  need  to  take  into  account 
large  variations  on  physical  parameters 

■  Uncertainties  for  aerodynamic  data  are  related  to 
experimental  measurement  or  round-off  errors 
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Plant  and  Flight  Condition  Uncertainties 

II  ^1  II  II  ^1  ^mnnnnfi 
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Aerodynamic  Database  Uncertainties 

ni  II  I  □□□□□□□DD 


parameter 

pdf 

% 

4' 

# 

flight  speed  [ft/s] 

U 

42.65 

+  15 

36.25 

49.05 

1 

altitude  [ft] 

U 

164.04 

+  100 

0 

328.08 

2 

mass  [lb] 

u 

3.31 

+  10 

2.98 

3.64 

3 

wingspan  [ft] 

u 

3,28 

+  5 

3.12 

3.44 

4 

mean  aero  chord  [ft] 

u 

1.75 

±5 

1.67 

1.85 

5 

wing  surface  [ft^] 

u 

5.61 

+  10 

5.06 

6.18 

6 

moment  of  inertia  [lb  ft^] 

u 

1,34 

+  10 

1,21 

1.48 

7 

parameter 

pdf 

o; 

# 

GH 

G 

-0.01215 

0.00040 

8 

CzH 

G 

-0.30651 

0.00500 

9 

c„[-] 

G 

-0.02401 

0.00040 

10 

Cx„  [racl-‘] 

G 

-0.20435 

0.00650 

11 

Cz„  [rad-'] 

G 

-1.49462 

0.05000 

12 

C,„  [rad-'] 

G 

-0.76882 

0.01000 

13 

Q  [rad-i] 

G 

-0.17072 

0.00540 

14 

Q  [rad-'l 

G 

-1.41136 

0.02200 

15 

C„  [rad-‘] 

G 

-0.94853 

0.01500 

16 
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lE^i  Critical  Parameters  and  Matrices 

I  ^1  II  I  □□□□□□□DD 

■  We  select  flight  speed  (r^j)  and  take  off  mass  (^)  as 
critical  parameters 

■  Flight  speed  is  taken  as  critical  parameter  to  optimize 
gain  scheduling  issues 

■  Take  off  mass  is  a  key  parameter  in  mission  profile 
definition 

■  We  define  critical  matrices 

A/  B^3  B  4 

■  They  are  constructed  setting  r^to  the  extreme  values 
(51,  (5|+,^y  (^+  and  all  the  remaining  Sj  are  equal  to  4 
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Phase  1:  Random  Gain  Synthesis  (RGS) 


II  ^1  II  II  ^1  ^mnnnnfi 
■  Critical  parameters  are  flight  speed  and  take  off  mass 


■  Specification  property 

=  {K\  A^  -  B^K satisfies  the  specs  below] 


e  [4.0, 6.0]  rad/s  [0.5,0.9]  e  [1.0, 1.5]  rad/s 

fpH  e  [0.1,0.3]  Acosp  <  ±  45%  ha>p„  <  ±  20% 


where  CO  and  ^  are  undamped  natural  frequency  and 
damping  ratio  of  the  characteristic  modes;  and  pjp 
denote  short  period  and  phugoid  mode 
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Spees  in  the  Complex  Plane 

II  II  I  □□□□□□□DD 
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Volume  of  the  Good  Set 


II  ^1  II  II  ^1  ^mnnnni 

■  Define  a  bounding  set  ®  of  gains  K 


«=  {K:  i=  i,...,4} 

■  Define  the  volume  of  the  good  set 

where  A  =  {  Aie  ®  n  } 

■  Volg  is  simply  the  volume  of  the  hyperrectangle  ® 
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Randomized  Algorithm  1  (RGS) 


^1  II  I  □□□□□□□DD 

■  Uniform  pdf  for  controller 
gains  K  in  given  intervals 

■  Accuracy  and  confidence 
£=4-10-5  and  ^  =  3-  lO'^ 

■  Number  of  random 
samples  is  computed  with 
“Log-over-Log”  Bound 
obtaining  N  =  200,000 

■  We  obtained  5  gains  K‘ 
satisfying  specification 
property  5] 
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Randomized  Algorithm  1  (RGS) 

~  II  ^1  II  II  ^1  ^mnnnni 

Given  e,  S  e  (0,1),  RGS  returns  the  set  of  gains 
satisfying  Si 

1.  Compute  iV  using  the  Log-over-log  Bound; 

2.  For  fixed y=l,2,. .  .,A^,  generate  uniformly  the  gain  random  matrix  K'  € 

3.  Set  C=0; 

4.  For  fixed  i=l,2,3,4,  compute  the  closed-loop  matrix 

AJ{K')  =  a;  -  BJ  Kh 
-\fK’ s  5],  set  C=  C-i-1; 

-  otherwise,  set  C  =  C; 

5.  End; 

6.  If  C  =  4,  return  the  gain  K'\ 

7.  Set i  =  j+l  and  return  to  Step  2; 

8.  End 
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Random  Gain  Set 

11  I  □□□□□□□DD 


gain  set 

Kv 

K, 

K' 

0.00044023 

0.09465000 

0.01577400 

-0.00473510 

0.00021450 

0.09581200 

0.01555500 

-0.00323510 

0.00054999 

0.09430800 

0.01548200 

-0.00486340 

K* 

0.00010855 

0.09183200 

0.01530000 

-0.00404380 

0.00039238 

0.09482700 

0.01609300 

-0.00417340 
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Phase  2:  Random  Stability  Robustness 
Analysis  (RSRA) 


II  ^1  II  II  ^1  ni 

■  Take  =  K‘  obtained  in  Phase  1 

■  Randomize  A  according  to  the  given  pdf  and  take  N 
random  samples  A' 

■  Specification  property 


52  =  {A:  A(A)  -  B(A)  satisfies  the  specs  of  } 

■  Computation  of  the  empirical  probability  of  stability  Pi^ 
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Empirical  Probability 

11  II  I  □□□□□□□DD 

■  Consider  fixed  gain 

■  Define  the  probability 

P,rue  =  fc  P  A)  d  A 

where  C=  { Ae  ®  Pi  ^2  }  and  p(A)  is  the  given  pdf 

■  Then,  we  introduce  a  “success”  indicator  function 

/(A/)  =  1  if  A/  G  52 
or  /(A')  =  0  otherwise 

■  The  empirical  probability  for  52  is  given  by 

Pn^^.ooJN 

where  is  equal  to  the  number  of  successes 
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Randomized  Algorithm  2  (RSRA) 


II  ^1  II  II  ^1  ^mnnnnfi 

■  Take  from  Phase  1 

■  Accuracy  and  confidence 

E  =  0.0145 

■  Number  of  random 
samples  is  computed  with 
Chemoff  Bound  obtaining 
A  =5,000 

■  Empirical  probability  is 
defined  using  an  indicator 
function 
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Randomized  Algorithm  2  (RSRA) 

II  II  I  □□□□□□□DD 

Given  e,  Se  (0,1),  RSRA  returns  the  empirical  probability  Pn 
that  S2  is  satisfied  for  a  gain  provided  by  Algorithm  1 

1.  Compute  N  using  the  Chernoff  Bound; 

2.  Generate  N  random  vectors  A  g  ®  according  to  the  given  pdf; 

3.  For  fixed y=l,2,...,A,  compute  the  closed-loop  matrix 

-  if  Arf(ZV)  e  52,  set  /(A)  =  1; 

-  Otherwise,  set  /(A)  =  0; 

4.  End; 

5.  Return  the  empirical  probability 
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Empirical  Probability  of  Stability 
for  Phase  2 

II  ^1  II  II  ^1  ^nnnn  ni 


gain  set 

empirical  probability 

K' 

88.56% 

90.60% 

89.31% 

K* 

93.86% 

85.14% 
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Probability  Degradation  Function 


^1  II  I  □□□□□□□DD 

■  Flight  condition  uncertainties  are  multiplied  by  the 
amplification  factor  p  >  0  keeping  the  nominal  value 
constant 


4s  p  [4-,^+]  fort  =  1,2,...,  7 

■  No  uncertainty  affects  the  aerodynamic  database,  i.e. 

4=  4"  fori  =  8,  9,  ...,  16 

■  For  fixed  ps  [0,1.5]  we  compute  the  empirical 
probability  for  different  gain  sets  K‘ 

■  The  plot  empirical  probability  vs  p  is  the  probability 
degradation  function 
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Probability  Degradation  Function 
for  Phase  2 

II  ^1  II  II  ^1  ni 
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Root  Locus  Plot  for  Phase  2 
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Phase  3:  Random  Performance 
Robustness  Analysis  (RPRA) 


II  ^1  II  II  ^1  ^nnnn  m 

■  This  phase  is  similar  to  Phase  2,  but  military  specs  are 
considered  (bandwidth  criterion) 


■  Specification  property 

53  =  {A:  A(A)  -  -B(A)  satisfies  the  specs  below ) 


C0g„  e  [2. 5, 5.0]  rad/s  Tp  s  [0.0, 0.5]  s 


where  cOgy/  and  Tp  are  bandwidth  and  phase  delay  of  the 
frequency  response 

■  Computation  of  the  empirical  probability  that  is 
satisfied 
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Bandwidth  Criterion 

11  II  I  □□□□□□□DD 
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Randomized  Algorithm  3  (RPRA) 

II  ^1  II  II  ^1  ^mnnnni 

■  Take  from  Phase  1 

■  Numer  of  random  samples 
is  computed  with  the 
Chemoff  Bound  obtaining 
^=5,000 

■  Empirical  probability  is 
defined  using  an  indicator 
function 


NATOLectureSeriesSC!-195  @RT  2008  1  61 


lEIIT-CNR 


lEirr-CNR 


Randomized  Algorithm  3  (RPRA) 

II  II  I  □□□□□□□DD 


Given  N  and  j=i, 2,. .  .,N,  provided  by  Algorithm  2,  RPRA 

returns  the  empirical  probability  that  Sj,  is  satisfied  for  a  gain 
Krand  pcovided  by  Algorithm  1 


1.  Forfixed7=l,2,...,A 

-  if  G  53,  set  /(A)  =  1; 

-  otherwise,  set  /(A)  =  0; 

2.  End; 

3.  Return  the  empirical  probability  Pn 
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Empirical  Probability  of  Performance 

for  Phase  3 

ni  ^1  II  II  ^1  ni 


gain  set 

empirical  probability 

K' 

93.58% 

95.16% 

90.80% 

K* 

84.78% 

96.06% 
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Probability  Degradation  Function 
for  Phase  3 
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Bandwidth  Criterion  for  Phase  3 

II  ^1  II  II  ^1  ^mnnnnfi 
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Gain  Seleetion 


^1  II  I  □□□□□□□DD 

■  Multi-objective  criterion  as  a  compromise  between 


different  specifications 


Finally  we  selected  gain  AT*  as  the  best  compromise 
between  all  the  specs  and  criteria! 
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Conclusions:  Flight  Tests  in  Sicily  -  1 

ft 

Conclusions:  Flight  Tests  in  Sicily  -  2 

1  II  ^1  1 1  II  ^1  ^1  ^nnn  nn 

1  ^1  II  1 1  1 1  II  irni^nnno 

■  Evaluation  of  the  payload  carrying  capabilities  and 

■  Satisfactory  response  of  MHIOOO 

autonomous  flight  performance 

■  Possible  improvements  by  iterative  design  procedure 

■  Mission  test  involving  altitude,  velocity  and  heading 

■  Stability  of  the  platform  is  crucial  for  the  video  quality 

changing  was  performed  in  Sicily 

and  in  the  effectiveness  of  the  surveillance  and 

■  Checking  effectiveness  of  the  control  laws  for 

monitoring  tasks 

longitudinal  and  lateral-directional  dynamics 

■  Flight  control  design  based  on  RAs  for  stabilization  and 

guidance 
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Infrared  Camera  -  2 

II  I  □□□□□□□DD 


lEIIT-CNR 


■  Two  open  problems 


PAC  Algorithms 

II  II  II  ^1  ni 


■  Optimization  with  sequential  methods 

■  Derive  “reasonable”  bounds  for  the  statistical  learning 
theory  approach 
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